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Manuscripts  in  preparation 

Kowler,  E.  and  Sperling,  G.  Independence  of  visual  search  from  stimulus 
onset  waveform.  To  be  submitted  to  Perception  and  Psychophysics 

Kowler,  E.  and  Sternberg,  S.  Programming  of  saccades.  Will  be  submitted 
to  Vision  Research. 


/  ABSTRACT 

l  * 

'  Eye  movements  determine  the  location  and  velocity  of  the  retinal 
image.  Thus,  to  understand  how  we  see  it  is  necessary  to  understand 
both  how  eye  movements  are  controlled  and  how  they  affect  visual 
information  processing.  The  proposed  research  is  concerned  with 
both  problems^  ^peci f ical ly:  ' 

(0  The  effect  of  expectations  on  smooth  eye  movements. s  The 

/  ' 

eye  moves  smoothly  in  the  direction  of  expected  future  target 
motion.  Experiments  will  determine:  (l')  how  expectations  and 
guesses  about  the  direction  of  future  motion  are  formulated  and 
(2)  the  relative  contr ibutions  of  expectations  and  retinal  image 


motion  to  smooth  eye  movements. 

^  (2)  The  effect  of  saccades  and  saccade-like  stimulus  perturb- 
'  ations  on  visual  information  processing^  Saccades  continually  dis¬ 
place  the  retinal  image,  yet  we  see  the  world  as  a  single  coherent 
picture.  Experiments  will  find  out  whether  the  visual  system 

selectively  tolerates  rapid  lateral  displacements,  or  whether  the 

,  » 

decision  to  move  the  eye  is  required. 

k 

(3)  ■Programming  sequences  of  saccades 
whether  sequences  of  saccades  can  be  pre-p 
use  of  such  sequences  improves  performance 


Experiments  will  show 
r^grammed,  and  whether 
visual  tasks.  1 


PROGRESS  REPORT  (January,  1981  -  December,  I98I) 


1.  Development  of  laboratory  facilities.  The  LSI  11/23  computer 
system  was  delivered  and  installed  in  April,  1 98 1 .  The  system  con¬ 
tains  a  centra?  processor,  memory,  serial  and  parallel  line  inter¬ 
faces,  clock,  analog-to-digital  converters,  digi tal-to-analog  con¬ 
verters,  and  an  electrostatic  plotter.  Hardware  and  software  inter¬ 
facing  allowing  computer  control  of  experiments  is  underway  and 
should  be  complete  by  September  30,  1 98 1 .  The  computer  is  currently 
being  used  for  analysis  of  data  collected  i ri  1 98 1  (see  descriptions 
of  experiments  and  results  below).  The  SRI  Double  Purkinje  Image 
Eyetracker  is  scheduled  for  delivery  on  or  about  October  1,  1981. 

An  appropriately  sized,  secure  table  to  hold  the  tracker  is  currently 
under  construction. 

2.  Experiments  on  the  role  of  saccades  in  visual  information 
acquisition.  Kowler  and  Sperling  (1980)  reported  that  saccade-like 
stimulus  perturbations  (abrupt  onsets  and  rapid,  lateral  displace¬ 
ments)  are  not  necessary  for  efficient  acquisition  of  visual  inform¬ 
ation  (see  proposal  pp.  2 ) .  Specifically,  they  found  that  perform¬ 
ance  on  a  visual  search  task  (identifying  the  single  numeral  in  an 
array  of  alphanumeric  characters)  was  not  improved  either  by  increas¬ 
ing  the  number  of  abrupt  onsets  of  the  display,  or  by  imposing  rapid, 
lateral  displacements  on  the  display.  This  result  suggested  that 
the  retinal  image  perturbations  produced  by  saccades  are  not  neces¬ 
sary  for  efficient  information  acquisition. 


Their  conclusion,  however,  was  limited  because  Kowler  and 
Sperling's  stimuli  always  contained  at  least  one  abrupt  onset.  In 
order  to  further  test  the  conclusion  that  abrupt  onsets  are  not 
useful,  I  completed  an  experiment  in  which  performance  on  the  same 
visual  search  task  used  by  Kowler  and  Sperling  was  measured  for 
displays  with:  (1)  gradual  onsets  and  abrupt  offsets,  (2)  abrupt 
onsets  and  gradual  offsets,  (3)  abrupt  onsets  and  abrupt  offsets. 

The  results  obtained  support  Kowler  and  Sperling's  original 
conclusion.  No  evidence  for  the  necessity  of  abrupt  onsets  was 
found.  In  fact,  the  waveform  of  the  onset  and  offset  had  only  min¬ 
imal  effects  on  performance.  The  small  effects  of  waveform  that 
occurred  do  not  suggest  an  important  role  for  abrupt  onsets.  Per¬ 
formance  for  displays  with  gradual  onsets  was  always  slightly  better 
than  performance  for  displays  containing  the  same  amount  of  energy, 
integrated  over  the  total  presentation  time,  with  abrupt  onsets 
and  offsets.  These  results  for  two  subjects  and  two  presentations 
times  (150  msec  and  250  msec)  are  summarized  in  Table  1. 

One  stimulus  variable  which  did  affect  overall  performance  was 
total  energy.  Performance  was  slightly  better  for  the  shorter 
presentations  times  when  total  energy  was  increased  by  a  factor  of 
two.  These  results,  however,  do  not  mean  that  visual  search  perform 
ance  depends  on  stimulus  energy  because  increasing  energy  improved 
performance  only  during  the  first  two-thirds  of  the  trials.  As 
subjects  became  more  practiced,  total  energy  no  longer  mattered. 

This  is  summarized  in  Figures  1  and  2,  which  show  how  performance 


changed  over  trials.  Note  that  total  energy  never  affected  perform¬ 
ance  for  the  longer  (250  msec)  presentation  time. 


These  results,  taken  together  with  Kowler  and  Sperling's  (I98O) 
results,  have  implications  for  the  role  of  saccades  in  visual  inform- 
ation  processing.  They  suggest  that  the  kind  of  retinal  image  per¬ 
turbations  produced  by  saccades  are  not  essential  for  visual  inform¬ 
ation  acquisition.  In  fact  such  perturbations  hardly  affect  perform¬ 
ance  at  all,  suggesting  that  saccade-tike  image  perturbations  are 
not  harmful  either.  This  is  a  useful  state  of  affairs.  It  means 
that  human  beings  can  use  saccades  at  will  to  fixate  regions  of 
interest.  They  do  not  have  to  increase  saccade  rate  in  order  to  keep 
already  fixated  regions  visible.  Also,  they  do  not  have  to  decrease 
saccade  rate  to  avoid  what  could  be  harmful  consequences  of  saccades, 
such  as  rapid  displacements  of  the  retinal  image,  or  brief  decrements 
in  stimulus  visibility  known  to  be  associated  with  saccades  (j_.£. , 
saccadic  suppression).  Results  obtained  so  far  indicate  that  such 
perturbations  have  little,  if  any,  effect  on  our  ability  to  acquire 
visual  information. 

Further  quantitative  analyses  of  these  results  and  a  ms  are  in 
preparation. 

3.  Experiments  on  programming  sequences  of  saccades.  A  common 
assumption  in  studies  of  tasks  requiring  use  of  saccades  to  scan  vis¬ 
ual  displays  is  that  saccades  are  planned  one  at  a  time.  Experiments 
are  underway  to  determine  whether  subjects  can  pre-program  sequences 
of  saccades.  The  experiment  already  begun  is  modeled  after  Sternberg 


7 


et_  aj_.  's  (1978)  study  of  p  re- prog  ramming  of  sequences  of  motor  re¬ 
sponses  used  in  typing  and  speech.  Sternberg  et_  a_K  (1978)  found 
that  characteristics  of  individual  responses  (latency  of  the  first 
response  and  time  between  responses)  are  a  function  of  properties 
of  the  sequence  as  a  whole  (e_.£.  ,  sequence  length).  Their  finding 
suggests  that  observers  prepare  all  the  motor  commands  for  the 
sequence  before  response  execution  begins. 

I  found  similar  results  for  saccades.  Two  subjects  were  pre¬ 
sented  with  either  I ,  3  or  5  stationary  point  targets.  They  were 
instructed  to  look  from  point  to  point  as  quickly  as  possible.  The 
mean  latency  of  the  first  saccade  increased  with  the  number  of 
points  presented.  This  result,  shown  in  Figure  3,  suggests  that 
motor  commands  for  the  entire  sequence  of  saccades  are  pre-programmed 
before  the  first  saccade  occurs.  It  now  becomes  feasible  to  propose 
to  study  characteristics  of  saccadic  programming,  for  example,  the 
effect  of  programs  on  performance  of  visual  tasks  (see  proposal 


Table  1.  Proportion  correct  reports  of  the  identity  and 
location  of  the  single  numeral  for  two  different  presentation 
times  (TIME),  four  different  waveforms  (WAVE)  and  two  subjects. 
Each  score  is  based  on  approximately  300  observations. 


Subject 

TIME 

WAVE 

EK 

BF 

150  ms 

-n. 

.68 

.57 

.72 

.56 

f — L_ 

•  75 

.60 

n_ 

.68 

.53 

250  ms 

.81 

.78 

r- — 

.84 

.79 

t — i _ 

. 8 9 

.74 

n — 

CM 

GO 

• 

.68 

Note:  Trials  consisted  of  a  sequence  of  9  frames,  only  one  of 
which  contained  a  numeral.  Presentation  time  refers  to  the 
time  between  onsets  of  successive  frames. 


Figure. 2.  Visual  search  performance  as  a  function  of  practice  over  trials. 
Subject  J5F.  Upper  functions  for  250  msec  presentation  times;  lower  functions  for 
1 .13  150  msec  presentation  times.  Symbols  indicate  waveform: 


